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*A proceduial Bibdel is presenl^ed for xhe -construct ioJi" 
,and vali'dation of an attitude scale in vocational educa^tion;, and -yie 
Jesuits of an instruaientation- study using that model are discussed, 
•'The three-stage model is cpropcsed cf:^, <t) stratification cf tlie. 
■ const]cuct;. ,(2) item' cpnstrdctl on and -selection; and <3) item* cluster 
analysis- 'In phas'e one, the . f cllowing steps are used; defining th^ 
universe of.the construct; listi:pc the major' components; £ui)dividin-g 
each 'component thoroughly; editip.g.to eliminate duplications and , 
ambiguities; and submitting stratification for expert* le view. For 
phase- two^ the following procedure is used: building an item bank; 
insuring accuracy of m-ea-nii^g; editing the items; submdtting items for 
expert review; adminas'tering jbhe trial instrumeni:; doing statistical 
anal,y!ifiii oi: the results and o,t the correlation cf each' ±x^%. with ail 



compojiwnt sub scores 'and with the total ^score; and selectiniO items for 
tlie final test form, Por phase three, the procedure, i;£ composed of: 
administering the instrument t'o, a second subset of the target 
population'; computing it-em-tc^-lxifc score and^ item-to-tctal score ' 
correlations; and performing additignjl item-to-subsccre. ^ 
correlations, (MH) ^ » . 
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Of all the tasks vocational educators are called upon to per^orm^ 
surely on of the most difficult is evaluation* Evaluative research in 
vocational educ?it1on has generally centered around Job placement^ 
competence, skill mastery, completions^ and other similar criteria. 
However, legitimate research questions periodically arise in vocational 
education which can only be answered in the affective, area. Unfortunately, 

* ^ * 

measurement of attitudes may well be the most difficult type of evaluation. 
As a f urther 'complication, until recently, attitude ii^trument development 
techniques had hot progressed to the level of spphistication or simplicity 
of the achievement test and manipulative instrument test construction 
pf'ocedures. More often than not, affective measures have been developed 

by Ahe researcher compiling a pool of items, subjectively selecting 'the 

^ ^ . . • ' ' • ., • 

items for use and then submitting the instrument to a panel of judges for 

* ... • • ■ 

validation. Clearly, a> systematic approach to instrument development and 
validation for attitude measurement is needed. 

^The purpose of this paper is to present a simplified, step-by-step , 

♦ * 

procedural model for the construction ^nd validation of one type of 
attitude scale and the results -of m instrumentation study which utilized 
that model. ' . " 
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BACKGROUND 

^ ' . Crespi {VSfe) defined attitudes as a "predisposition to behave in 
Sfpecific ways ta specific stiimjll," thus accounting for the tendency/ of 

^ijple to behave in a generally consistent manper. He further contended 
that even a simple object may be regarded "as consisting of a nunter of 
elements.'irpr component parts, each of .which may be the subject of varying 

aftAitud'es, \ ^ ^ . ' 

Remmers (1954) provided another definition of attitude as "an 
effectively toned idea or group of ideas predisposing the organism to 
action with ref^rlfence to specific ... objects,". He theorized that 
attitu(|es are a component of all behavior, overt ^s well as covert. 
Remmers '"further enumq^ated- severa.l assumptions generally made by attitude 
researchers: 

1. attitudes are mea^rable 

2. t hey. vary along a. I^nfear continuum 

3. attitudes*are conwon td''^! group • . 

* attitudes are held by roati| .people ' 

5. they are temporary and chan^i^ble • » 

6, they are subject to rationalization an/ deception 

.In addition, Renmers described several typ^gt of instruments used to ' 
measure attitudes: ' . * 

1. A-priori scales * . ^ ' • 

2. psycho-physical scales * ^ 

3. sigma scales ' * • 

4. master scales . • • 

t ' - ' • 

' 5. behavior scales * 



6. summated scales 



, Kerlinger (1964) discussed several alternative techniques available 
fo^ validation of such Instruments as the sunmated (or Likert-type)' scaje 
described by Renroers, above. . 

content validity, ' ' , 

predictive or concurrent validity, & 

construct validity > » 
He indicated that content validation was best used in construction of ,^ 
achievement instruments and that construct validation was appropriate 
in attitude scale construction, 

. Bohrnstedt. (1970) argued "that 'the approach of content validation 
could prove much more useful than it had in construction of attitude 
scales. He developed a three stage model for the construction and 
content validation of attitude scales: 

1. stratification ot the construct ^ , 

2. item. construction and selection 

3. item cluster analysis ' • ^ . ♦ ' 

In stage one, the universe of the attitude scale is defined. Then,' 
:the domain is stratified into its major components with a, cr-itical concern 
that the' strata, broadly encompasses the entire construct. Each component, 
or stratum, is then subdivided into what Bohrnstedt called substrata. The 
substratification is then continued until the outline exhausts the content 

* 9 

of the universe. » In essence, the product of stage 1 is a detailed outline 
of the c^struct which the attitude scale is to measure. ' 

Stage two is the construction of items to "capture the shades of 
meaning associated with each stratum and substratum." Bohrnstedt contends 
that a minimum of seven to ten* items should be written for each stratum. 
Although this point is not specifically considered,^ It would appear that If 



the substratif.1 cation is fairly deta-iled, the requirement for the number 
of 1tens would be met if the main stratum, or component, contained the 

seven to ten items, rather than each substratum, 

* • " . ■ ■ ^ 

The third stage calls for Cluster analysis of items after initial 

data have been gathered. .The purpose here is ^ determine whether each 

stratum is relatively homogeneous and relatively independent of each of 

the other strata. This can t>e accomplished by either of two separate 

methods, both of which will be delineated in the next sectfon of the paper* 

It would appear that Bohrnstedt's model provides not only content 

validation but also construct validation. It forces a detailed delineation 

of the constrct beina studied by 'a review of the .theory underlying .that 

construct as it is presented in the literature. Further, the item cluster 

' analysis technique, while differing from factor analysis in approach, 

-somewhat resembles f acto^nalysis in result. In factor ^nalysis, the 

'pool of items is broken down into spatially related factors. In this 

cluster analysis technique, the «f actors,", or strata, are derived logically 

as a result of the literature research, and the statistical treatment of 

the data is done to verify the homogeneity of each stratum. Indeed, having 

9 

developed a basic Instrument by Bohrnstedt's methodology, thereby establish 
ing both content validity and construct validity, further treatment of the 
instrument by factor analysis techniques might serve to provide further 
, evidence of construct validity, 

INSTRUMENT CONSTRUCTION PROCEDURE - 
The procedure' outlined here represents an application and expansion 
of Bohrnstedt's technique and is based upon experiences of the author in 

'development of the instrument being described partially in this section . 

• • • ' ■ 

amd more fully in the RESULTS section. 



Phase I - 'Stratification of the con-strutSt). ^ • 

T. Define in detail the universe of the construct* to be measured, . 

In the ^ase of career education; » any. number of definitions can . 
be found. For the purpose of thfs' particular stud^, the foil-owing 

definition was' used: "a comprehensive educational* (approach) 

T ' . • . . • 

focused on careers, which begins at grade one, or earlier, ^nd 
continues through the adult years", * . . , - 

2, Break the construct down into its major strata or components. 

Again, career education has been delipeated in numeroi^ ways and 
no clear: consensus exists concerning the precise nature andj'abels 
of all its major components. For the purpose of this study, caVeer 
education was assumed to consist of five major strata as shown in 
figure 1, 
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figure. 1 - Strata of Career Education 



3. Subdivide eJfch stratum ijfTto substrata. 

Each component (or stratum) of career education was further 
broken down (substratif led) in terms of general developmental realms 
of expected student outcomes as follows: (A) self-concept and social 
development, (8) world of work, (C) education, and (0) decision- , 
making and problem-solving. This step was derived largely from 
earlier works by Asche (undated) and by Bailey and Stadt {1973)> and 



resulted In a 4 X 5 indtT>fx which hopefully represents all the general 
areas of expectations of career education in terms of student 

f 



outcomes - se^e figure 2. 
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figure 2 - Matrix representing Career Education 



,4. Continue this process to exhaust the universe of the construct. 

For each cell in the mati^ix, one or more "specific expected student 
outcomes were delineated, as in figure 3. . ' 
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figure 3 - Excerpt from Substratifi cation of Transition Stratum, Xamp (1977) 



5, Edit^he stratification to eliminate duplications and ambiguities 

6. Submit the stratification to a panel of judges to determine 
whether it accurately" and exhaustively delineates the construct to be 
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measured^ 

Phase 1 will be the basis upon Vhich the ai^gument of content validity 
will be made. * ' * . ' . « 

Phase 11 - item construction and selection . ^ • 

'1, Build a pool of items ' ^ : ^ 

' ■ ' • ^' 

As in the development of any Lycei:^-typ£ sc/ile, the items were 

■ ^ \ . ^ .-^ • ■' *• ■ , , , , ' 

viritten. as short statements or opiiTlon relative to some aspect of ^ 

■ ■ .•• • ■ \ - • • " ^. • ■ 

the construtit of career education." Each item was intentionally 

« ^ 

written to express a judgement rather than factual information. 
Items were collected from a ntiraber of traditional sources includirtg . 
both pro and'con statements suggested by career education, literature, 
teachers, administra\ors, .university specialists, graduate students, - 
^and so fprth. In each x;ase, the^tatement was classified as either 
favorable or ujnfavorable \oward the general tenets of career i 
education and a correspond^g statement expressing the opposite 
viewpoint was \iliritten. The result was a pool of bipolar items - i.e. 
cine version -in t^e negative sense toward the dogma of .career- education, 
the second version. in;the positive sense. For an example of a bipolar 

♦ 

item, see figure 4. . , ► * / 

Positive Form - Before graduation, every student should 
' have some sort of '^ork* experience. 

'Negative Form - Students shotild wait until after graduation . 
^- \ to get real "work" expert' ences. 

, figure'4 - Bipolar Item 

2^ Irisure that Items •'capture the shades of meaning" of each 
stratum* 

1 In this case, ttie initial pool of items was compared to the 



i 



completed and validated substratif'ication of career education. Each 
item was paired with tfje expected student outcome in the outline to 
which the item was judged to correspond. Of the several hundred 
ft ems initially constructed, all logically paired with one or more 
substrata elements. This result provided still further evidence of 
the validity and comprehensiveness of the stratification developed 
in Phase I. A number of elements remained, however, without corre- 
sponding bipolar items. The fact that the pool of items was exhaustfed 

* * 

by the stratification whereas the "stratification was not exhausted, 
by the pool of^items, implies that the item pool which had been 
constructed by traditional means did not completely-represent all 
aspects of career education and that,, had the item building process 
stopped'*at this point, the resulting' instrument- would not have 
comprehensively addressed the broad construct of career education. 
In each' case at* least one bipolar item was then constructed ' 
' specifically to measure those remaining elements in the^ outline. If 
the i)utlihe actually and exhaustively represented the content of 
career education, as the first validation panel agreed it did, then 
the itemipool at this point should fully reflect the content of ^ 

career education, , ' . . - 

-\ 

3: Edit the items for clarity, ambiguity, and reading level, holdiftg 

in mind the target population. ^ , ' 

4, Determine the number of items desired on thl-Ci^^^ instrument and 
' - * . ^ 

randomly -select* at least twice that number from the item pool. ^ 
For the purpose of this study, it was planned to retain fifteen 
(15) items for each component, so thirty trial items were selected 
for the Initial instrument. Use of 'the negative or positive version 



of the item was ^Iso determined randomly it this point. 

5» Submit this initial version of the instrument to a second panel ^ 
of judges to determine whether it adequately and accurately addresses the 
tonstruct as defined by the previously validated stratification. This step, 
combined with Phase J form the basis for the claim of construct validity* 

6. Administer th^ trial instrument thus obtained to a subset of the 
population for whom the'instrument is 'to be used^, 

7. J Totals all the items originally written to measure each respective 
nitjor striatum to provide stratum subscores. Then' total all the items 

to provide a total score, 

8. Intercorrelate each item with ^all stratum subscores and the 

^ - 

total score,' 

\9j Any item which does not significantly correlate with both Hs own 
Stratum subs'core and the total score should be deleted, 
f 10. Any item which coiVelates higher^ with the subscore of «ny stratum 
other than its own should b\considered for reclassification or deletion. 

n. ^ From the remaining items, select those to be retained on the final 
instrument based uponritem-to-own%ubstore correlation and itera-to-total 
score correlation, or any other set of logically defensible, predetermined 

criteria deemed appropriate by the researcher. ' ^ 

* • ; f 

12^ I" general, approximately half the selected items should be 
negative and half positive, ^ / • * * 

Phase III - item cluster analysis^ 

1, Administer the instrument to a second subset W the target ^ 
population. 

2. Compute itera^o-subscore and item-to-total score correlations 
for all items and all strata subscores, see Table 1. . 
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Table 1 - Product-Moment Correlations for Stratum I Items 
in Final Instrument, wi'th all Stratum Subscores 
. and Total Score*** N»155 . . \ ' 



item 



Number 


I 


ir 


III 


IV 


V 


TOTAL 


'1 

3 

« 


.3561 
.4338 
.4030 


:1383 
.2788 
,?247 

> 


.1789 ' 
,2714 
>.1556 


.176,6 
.2847 
.1665 


— *. ^ 

.1073 
,2956 
.2341 


;2261 ' 

.3741 

.2795* 


* * 

• 

15 .\ 


.4fe30 


.2658 


.2757 


.3202 


,2828 


.3760 


f 


,3930* 


.2274** 


.2237** 


.2204** 


.1893** 


,2981 



Withtn-component r 



f 



** Differs from within-component f at ,05 level of 
significance 

*♦* This table is taken directly from Camp (1977). It / 
represen_ts intercorrelations between each of fifteen 
itemv in stratum 1 with each of the five strata 
subscbres and the oveVall total from an-aidminstr.ation 4 
of an actual, instrument developed by this technique. 
For example, the correlation between item number 3 in 
\) ' stratum I- (see figure 1) and the total score fy stratum 
I was ,40,* while the correlation between that same item 
and the straturri V total scoire was .23. 



3. Compute the mean of the item-to-subscore* correlations for/ all 
\ items in stratum 1 with each of the straturri subscores, see ir line in 
• Table, the wi thin-stratum correlation mean is then compared to each of 
the between-strata correlation means respectively. If the wi thin-stratum 
correlation mean is significantly greater than each, of the between-strata 
means, then the conclusion is drawn that stratum I is relatively independent 
and horoogeneo^us, thus providing further evidence of the validity of both 
the original stratification developed in Phase I and the instrument ^ — 



• 



developed in Phase II. 
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• 4. The same process 1s repeated for all the Items in each respective 
stratum, .. " . 

5. If the stratum correlation means are not found to be significantly, 
different, th^ conclusion of relative stratum Independence and homogeneity 
cannot be drawn. This alone would not be adequate cause foe discarding the 
instrument. The claim could still be made of both content validity and con- 
struct validity based upon the construction procedure as oreviously outlined. 
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